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Abstract 

The difference between the terms additivity and extensivity, as well as their respective 
negations, is critically analyzed and illustrated with a few examples. The concepts of 
subadditivity, pseudo-additivity, and pseudo-extensivity ai^e also defined. 



To say that a given quantity (physical or mathematical) is additive and to say that a quantity is 
extensive are two different affirmations which, unfortunately, appear too often as undifferenti- 
ated in the physics literature. The assimilation of the two terms is especially present in studies 
related to the entropy measure of Tsallis and to the so-called field of non-extensive thermo- 
statistics or Tsallis' statistics which is based on this measure of entropy In these studies, 
it is not uncommon to see the words additivity and extensivity being used as synonymous, and 
to read sentences such as "...the appropriate framework to describe non-extensive behavior is 
Tsallis' statistics, because of the non-additivity property of Tsallis' entropy." But, how exactly 
is the non-additivity property of Tsallis' entropy related to non-extensivity? Are these concepts 
linked together simply because they are thought to mean the same thing? 

These questions are raised not with the intention of criticizing the results related to non- 
extensive statistics; what is more important is the fact that they point to a somewhat misleading 
and careless usage of scientific jargon. That this carelessness persists would not by itself be 
so problematic, were it not for the fact that the difference between additivity and extensivity 
is at the very root of the issues raised by non-extensive statistics. For this reason, it seems 
more than advisable to rehabilitate the proper meaning of these two terms by reviewing their 
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standard 'textbook' definitions. This is the purpose of the present contribution. Of course, in 
doing so, no new results are likely to be conveyed; however, it can only be at our advantage to 
repeat a number of concepts and definitions which are fundamental to statistical physics. As 
Wittgenstein once wrote: "what can be said at all, can be said clearly." After reading this short 
review, it is hoped that researchers will follow this advice, and will indeed be more perspicuous 
in discussing any subject which connects itself to additivity and extensivity. 

To begin this review, let us fix the context of the discussion. The quaUfiers 'additive' and 
'extensive' apply to systems which are composite in the sense that they are composed of many 
components or subsystems. A typical example of such composite systems is a gas composed 
of many identical particles which may or may not interact with each others. If we label these 
particles by the index i = 1, 2, . . . , n, and represent the state of each of these particles by using 
the variable xi, then the possible interactions which may exist between the n particles can be 
modeled either in the form of a total energy or Hamiltonian function U{x^) associated with the 
joint state = xiX2 ■ ■ - Xn of the complete system, or, more generally, by n joint probability 
distribution p{x^) which gives the probability that the particle 1 of the gas is in the state xi, 
particle 2mx2, and so on. 

Now, suppose that we are interested in calculating or in measuring physically a quantity (an 
observable) which is a function, say Q(.t"), of the joint state of a composite system. For this 
quantity, we may ask: can be evaluated with the recourse of terms of order lower than 

n, i.e., with terms Uke Q{x"''), where x'^ is any m-particles sub -state of x'^ with m < n? In 
particular, can it be decomposed as the sum of the (5(xi)'s? The concept of additivity partly 
classifies, as follows, the answers that these two questions can receive. 

Additivity. A many-body (or joint) physical observable Q{x^) is said to be addi- 
tive with respect to two subsystems with states = xiX2 - ■ ■ Xm and x'^~'"^ = 
Xm+iXm+2 ... if = Qix"') + Qix^-"'). 

Obviously, this definition can be generalized to any partitions of the joint state in two or 
more subsystems. As a result, we have the following stronger version of additivity. 

Complete additivity. Q{x'^) is said to be completely additive if it is the sum of the 
one-particle (or marginal) contributions to Q, i.e., if = Q{xi). 

A first example of a completely additive quantity which immediately comes to mind is 
the total energy of a set of non-interacting bodies (e.g., the particles of an ideal gas). 'Non- 
interacting', in this case, can in fact be taken to be equivalent to 'additive energy', because, as 
we all know, interactions appear in the expression of the total energy as extra irreducible energy 
or potential terms which, in effect, allow a finite number of bodies to exchange energy. These 
terms are irreducible in the sense that they are themselves non-additive. 

In the case where p{x"-) is given instead of ?7(x"), a similar characterization of the prop- 
erties of p(x"') is possible if one interprets the logarithm of the inverse of this quantity as 



some kind of energy U{x^), or pseudo-energy in order to distinguish it from the 'real' en- 
ergy U{x"-). This is the basis of the so-called thermodynamic formalism of stochastic systems 
[||, 0, Ip. In short, if p{x"-) is factorizable or separable, i.e., if it can be expressed as the prod- 
uct = p{xi)p{x2) ■ ■ ■ p{xn) of marginal probability distributions, then the corresponding 
pseudo-energy is additive: 

n n 

U{x^) = -lnp(x") = -^lnp(xi) = ^^^/(x,). (1) 

i=l i=l 

On the other hand, when is non-factorizable, U{x^) becomes non-additive. Indeed, in 

this latter case, can only be written generically as a product of conditional probabilities 

of the form 

= p{xi)p{x2\xi)p{x3\xiX2) ■ ■ ■ p{Xn\x"-~^), (2) 

which makes obvious that Eq.(|l|) is no more satisfied. In fact, each conditional probability 
term p{xm\x"^~^) above can be assimilated, again by taking the logarithm of its inverse, to an 
interaction pseudo-energy U{x'^) which enters in a non-additive fashion in the expression of 
U{x"'). This makes the connection with the properties of U (x") more evident. (The connection 
is even more effective when both U{x^) wAU{x^) can be defined and related to each other, as 
in the case of thermodynamic systems. See Refs.lQ, ^ for more details.) 

Another quantity which is also completely additive for independent systems, and which is 
worth mentioning because of its great importance in statistical mechanics, is the joint Boltzmann- 
Gibbs-Shannon (BGS) entropy of a sequence X" = X1X2 ■ ■ ■ Xn of random variables: 

= -^p(x")lnp(x'^). (3) 

By inspecting the above expression, one can see that the joint entropy H{X"-) is nothing more 
than the expected total pseudo-energy (also called bit-number [Q]) over all joint states x". As 
a consequence, one readily concludes that H{X"-) is additive if and only if p(x") is factoriz- 
able. As an added property, it can also be shown that H{X"-) is strictly subadditive otherwise, 
which means that H{X^) < X]r=i H{Xi) when the random variables forming the state X" are 
correlated in one way or another [^]. At glance with the BGS entropy, the joint version of the 
entropy measure of Tsallis, given by 

^,(^") = ^(i-E^^(^t), (4) 
is non-additive for independent random variables. For instance, it can be verified that 



H,{Xi,X2) = H,{Xi) + Hg{X2) + (1 - q)H,{X^)Hg{X2) 



(5) 



for Xi and X2 such that X2) = p{xi)p{x2) for all xi and X2 It is precisely because 
of this property that Tsallis' entropy is referred to generically (but perhaps too generically) as 
being non-additive. 

Let us now turn our attention to another aspect of composite observables which concerns 
their scaling properties with the number of subsystems. Given again a function Q{x"-) of the 
joint state x", we are interested in determining if Q{x"-) scales proportionally with n or, at 
least, asymptotically proportionally with n when this number becomes large. If it does, then Q 
is termed extensive. More precisely: 

Extensivity. A joint observable is extensive if the Q-density, defined by the 

ratio Q{x'^)/n, reaches a constant in the limit n — > 00. If random variables are 
used, a criterion of convergence (e.g., convergence in probability, almost surely, 
etc.) should also be provided in order to give a meaning to the limit. 

In relation to this definition, physicists commonly say that a system possesses a thermodynamic 
limit if its total energy and total entropy are both extensive quantities 

At this point, it is important that the reader clearly distinguishes the concept of extensivity 
from that of additivity. In general, extensivity does not imply additivity, nor does additivity 
imply extensivity. (The latter assertion is a common pitfall.) On the one hand, there exist 
joint observables which are non-additive, but which are nonetheless extensive. The joint BGS 
entropy of ergodic sequences of correlated random variables is often cited as an example of 
a quantity which is non-additive, but which converges in density to a constant known as the 
entropy rate. (See [Q, |6|] for a definition of ergodic stochastic processes, and [^] for a description 
of entropy rates.) On the other hand, a quantity may well be additive without being extensive. 
For instance, it is not so much difficult to construct a system composed of independent particles 
characterized by a total additive energy U{x^) which has no limits in n. But, admittedly, this 
would be a very peculiar and exceptional example of an additive yet non-extensive quantity, 
since, in most cases encountered in physics, additivity does imply extensivity. Furthermore, in 
many models of physical systems, the fact that a quantity Q is non-extensive is intimately related 
to the fact that it is non-additive, for it is usually the non-additive part of this quantity which 
divergences as n ^ 00, and which thus prevents the Q -density to converge. Such a singularity 
occurs, for instance, when the interaction energy or pseudo-energy between subsystems is long- 
range in the sense that it decays very slowly with the distance (if we are concerned with particles 
in space) or with the neighborhood separation (as for spin-lattice systems). The dimensionality 
of the system considered plays also an important role in defining what 'long-range' means (see, 
e.g.,[|,i). 

By way of conclusion, note that it is sometimes possible to transform a non-extensive quan- 
tity into an extensive one by rescaling it using a volume ( n) dependent factor or, simply, by 
dividing the quantity in question by its nonlinear scaling law if it is characterized by such a 
law (Kac's prescription [^). The 'renormahzed' quantity which results from this procedure 



is called pseudo-extensive (see ^ for a specific example). On a related note, a non-additive 
quantity Q{x^) may be written in a pseudo-additive way if one can find another quantity Q{xi) 
such that 

n 

Qix^) = J2Qix,), (6) 

1=1 

with the additional requirement that Q{xi) = Q{xi) for all i whenever Qix"^) is additive. This 
last concept of pseudo-additivity is probably not well-known to many; yet, it is effectively in 
use when one expresses the total energy of a gas of electrons in a semiconductor as a sum 
of free electron energies with a different renormalized or effective mass factor. At the level 
of the entropy, a related procedure has also been described recently by which the joint BGS 
entropy H{X^) of an ergodic source of correlated random variables can be transformed in an 
pseudo-additive fashion as the sum of the marginal Tsallis' entropies Hq{Xi), i = 1,2, . . . ,n, 
all assuming the same fixed value of q > 1 [^. This opens up, perhaps surprisingly, the 
possibility of applying Tsallis' entropy to a wider class of systems than previously thought, 
and, particularly, to the class of fully extensive systems which have been hitherto neglected by 
the community of researchers working on Tsallis' statistics. 
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